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Abstract — We consider large scale cost allocation problems 
and consensus seeking problems for multiple agents, in which 
agents are suggested to collaborate in a distributed algorithm 
to find a solution. If agents are strategic to minimize their 
own individual cost rather than the global social cost, they are 
endowed with an incentive not to follow the intended algorithm, 
unless the tax/subsidy mechanism is carefully designed. Inspired 
by the classical Vickrey-Clarke-Groves mechanism and more 
recent algorithmic mechanism design theory, we propose a tax 
mechanism that incentivises agents to faithfully implement the 
intended algorithm. In particular, a new notion of asymptotic 
incentive compatibility is introduced to characterize a desirable 
property of such class of mechanisms. The proposed class 
of tax mechanisms provides a sequence of mechanisms that 
gives agents a diminishing incentive to deviate from suggested 
algorithm. 

I. Introduction 

A common difficulty in large scale optimization prob- 
lems that arise in social, infrastructural, and communication 
networks is the heavy computational load that cannot be 
handled by a single computer. A practical solution algorithm 
for such problems should thus be parallelizable so that 
the computational load can be distributed over the network 
agents. Another potential challenge in such problems comes 
from the fact that nobody has access to the entire data 
defining the optimization problem, because this information 
is often private and localized within distributed agents. 
Hence, it is desirable that a solution algorithm allows agents 
to implement the algorithm without knowing other agents' 
private information. 

In this paper, we consider two distributed algorithms that 
are both attractive in the above sense: the dual decomposition 
algorithm for cost allocation problems, and the average con- 
sensus algorithms for a consensus seeking. In the majority 
of the literature on these algorithms, it is assumed that the 
distributed agents are "benevolent" and blindly follow the 
intended algorithm. However, if the society involves rational 
and strategic agents, it is more realistic to assume that they 
behave in more selfish manner in an effort to minimize their 
individual cost rather than the global social cost. Hence in 
this paper, rather than assuming that agents are collaborative, 
we consider a mechanism by which rational agents are 
incentivised to follow the intended distributed algorithm. 
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Mechanism design theory ([1], [2], [3] to mention a 
few) concerns the question of how the society can make a 
preferable decision with the presence of strategic agents. The 
goal of a mechanism design is to suggest a social decision 
procedure (together with a tax/subsidy mechanism) that 
incentivises agents to follow the intended action. However, 
the framework of the classical mechanism design theory 
is often insufficient to handle more complicated distributed 
algorithms. 

It is relatively recent that the discipline of algorithmic 
mechanism design [4] was recognized in computer science. 
Inspired by [5], we formulate a distributed mechanism design 
problem and suggest a tax mechanism that incentivises 
agents in a certain sense to follow the intended dual de- 
composition and the average consensus algorithm. Our tax 
mechanism can be seen as a generalization of the celebrated 
Vickrey-Clarke-Groves (VCG) mechanism. 

By its nature, these two algorithms are asymptotic algo- 
rithms: if terminated at some finite step, only an approxi- 
mation to the optimal solution is obtained. It is recognized 
in [6], [7] that the VCG mechanism combined with such an 
approximated solution does not guarantee incentive compat- 
ibility in general. To circumvent this difficulty, we introduce 
a notion of asymptotic incentive compatibility for a sequence 
of mechanisms that provides agents a diminishing incentive 
to deviate from the intended algorithm. 

Finally, with the present study, we are able to relate 
our earlier study of real-time electricity pricing scheme [8], 
[9] to the mechanism design theory in more solid manner. 
Moreover, the framework of distributed mechanism design 
potentially allows us to implement the pricing scheme in 
[8], [9] in a smarter way: it allows distributed computations 
and allows agents not to disclose their private information. 



II. A Quick Review of Mechanism Design 

A. Mechanisms 

Consider a society Ejq comprised of N agents. Besides 
these agents, the society also has a government who makes 
a social decision x <G X C W 1 . Each agent i = 1, ■ ■ ■ , N 
has private information 0, e 8i called type. When a social 
decision x is made, the intrinsic cost Vi(x;6i) is charged 
to the i-th agent. The government desires to make a social 
decision x in such a way that the sum of individual costs is 
minimized. If the agents' types 9 — {6\, ■ ■ ■ ,6n) € @i x 
• • • x Ojv =: 8 are available to the government, the desired 



social decision is given by 



N 



x(9) = argminy^i>i(:r;6>.;). 
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A map x : — >• X is called a decision rule. A decision rule 
is said to be efficient if 
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for all 6 and for all a;' € AT. Since is private in 
reality, each agent is asked to report his type (denoted by 9i) 
to the government. In this process, we assume that agents 
are strategic in that they are allowed to make an unfaithful 
report (i.e., 9i ^ Qi). Notice that agent i has an incentive to 
do so if it will lead to an alternative social decision x' that 
costs less for himself, i.e., Vi(x';9i) < Vi(x(9);9i). 

In order to encourage agents to be truthful, the government 
can introduce a monetary transfer function t : — > M. N , This 
can be seen as a tax mechanism that the government imposes 
on each agent. We assume that the amount of tax imposed 
on each agent is determined by the government using the 
reported type 0: 



t(9)=(t 1 0),--- ,t N 0J) 



Overall, agent i's net cost is given by 

Ui0,6i,x,t) =Vi(x(O);Oi)+ti0) 

and agents are expected to behave rationally to minimize this 
function. The pair f(6) = (x(9),t(9)), f : 6 i-> X x R N is 
called a social choice function. 

The reporting process can be designed in an indirect 
manner using message functions Sj : 0, —> £j, where 
£ = Si X • • • X Ejv is the space of messages. Upon 
receiving "encoded" types s(9) — (si(#i), • • • , Sn(9n)), the 
government recovers the value of the social choice function 
using a "decoding" function g : E — > X x R^ such that 
(g o s)(0) — f(9) for every 9 6 0. A mechanism is a 
triplet M = (g, E, s) of an outcome function g, a space of 
messages E, and a particular encoding scheme s : — ► E 
such that g o s = f (see Fig. [Th. One can think of s as an 
intended encoding scheme that the government desires each 
agent to follow. A particular case with E = 0, g = /, and 
s = Id (i.e., identity map) is called a direct mechanism, 
in which agents are asked to report their types 9i to the 
government without encoding. A mechanism is said to be 
dominant strategy incentive compatible if implementing the 
suggested encoding scheme s = (si, • • • , Sn) is a dominant 
strategy for each individual. If there exists such a dominant 
strategy incentive compatible mechanism M = (g, E, s) such 
that / = gos, f is said to be implemented by M in dominant 
strategies. Since the government announces a mechanism 
first and the agents react to it, the government and the agents 
are also referred to as the leader and the followers in what 
follows. 




Fig. 1. A pair / = (x, t) is called the social choice function while a pair 
g = (x,t) is called the outcome function 



B. Fundamental results from mechanism theory 

If a mechanism (g, E, s) implements a social choice 
function / = (x, t) in dominant strategies, then a direct 
mechanism (gos, 0, Id) implements / in dominant strategies 
as well (revelation principle). This suggests that a given 
social choice function is implemented by some mechanism 
M if and only if it is implemented by some direct mechanism 
in dominant strategies. 

If the government wishes to design a mechanism that im- 
plements a particular social decision rule x without introduc- 
ing monetary transfer function (i.e., t = 0), then the decision 
rule has to be quite trivial (Gibbard-Satterthwaite theorem). 
This suggest that a tax (or subsidy) mechanism is almost 
necessary for the government to incentivise individuals to be 
truthful to make the right social decision x. 

Let x : — > X be an efficient social decision rule. It is 
elementary to prove, but valuable to realize that there exists a 
class of monetary transfer functions t Groves : — y M. N such 
that a direct mechanism (f,Q,Id) with the social choice 
function / = (x,t Groves ) is dominant strategy incentive 
compatible ([3] for a great introduction). Such a class of 
monetary transfer functions are given by 
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(0)5 0,-) (lb) 



tf rm ' es (9) = k i (L i ) + J2 v ^ 

for each i — 1, ••• ,N, where ki : EL^t ®j ^- ^ is an 
arbitrary function that does not depend on 9 t . A mechanism 
obtained by the above scheme is referred to as a Groves' 
mechanism. It is known that the form of monetary transfer 



function ( lb i is not only sufficient but also necessary in 
in order for x to be efficient and 
(x, t) is dominant strategy 



an appropriate sense, 

a mechanism (/, 0, Id), f 

incentive compatible (Green-Laffont theorem). 



C. VCG mechanisms 
A particular choice of 



n ^^2 v j( x '^i 



xex 



yields a mechanism with some additional desirable prop- 
erties. With this choice, the monetary transfer function 
becomes 

tY CG 0) = E v 3 (x Groves (h W-mm^ix; 9 3 ). (2) 



Let E^-i denote the society excluding the i-th agent. The 
first term in d2| corresponds to the total cost of TV — 1 
agents (excluding i) when an efficient social decision is made 
for En. The second term in |2]) represents the minimum 
social cost achievable for E^-i- Combined, d2| means that 
the tax imposed on the i-th agent is the same amount as 
the marginal contribution of the z-th agent to the rest of 
the society. The Groves mechanism with tax policy pi is 
called the Vickrey-Clarke-Groves (VCG) mechanism, which 
is known to be advantageous from the viewpoint of budget 
balance and individual rationality [2]. In order to compute 
d2), the government needs to determine social decisions that 
minimize the cost for each of En and E^-t, i — 1, ■ ■ ■ ,N. 

III. Distributed Mechanisms 

A large body of mechanism design theory focuses on 
direct mechanisms. Although this is partially justified by the 
revelation principle, clearly there are a number of practical 
situations in which "indirect" mechanisms are preferable. 
For instance, indirect mechanisms allow distributed compu- 
tations for large scale problems, while direct mechanisms 
require central computation by the government to determine 
the optimal social decision. Indirect mechanisms will also 
be advantageous for privacy preservation if they allow to 
find the optimal social decision without having individuals 
disclose their private information completely. 

Previously, we considered S as the space of messages and 
g : £ — > X x R N was viewed as a decoding scheme. 
From this section on, we want to consider more general 
computational interactions between the leader and the fol- 
lowers than mere encoding-decoding interactions. Specifi- 
cally, we assume that the interaction between the leader and 
the followers occurs in multiple stages (indexed by k = 
1, 2, • • ■ , K). At each stage, the leader broadcasts his current 
computational output y\ to the followers. Also, we assume 
that each follower transmits his current computational output 
y k directly to the leader (and possibly to the neighboring 
followers, depending on the communication topology) via 
secure channels. We assume that the leader can be modeled 
as a state-based computer with the internal state z\, while 
the i-th follower can be modeled as a state-based computer 
with the internal state z k . Given initial states z°,z° and 



Leader 



1, • • ■ ,N, the state evolves according to: 



k _ f~ik i -k-1 
»? = #&(*?) 

z k L = G k L (z k L -\y1, 

y k L = H k L (z k L ) 
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(3a) 
(3b) 
(3c) 
(3d) 



for k = 1,2, • • • ,K. In the above, {Vj~ 1 }jsN(i) represents 
the outputs of the neighboring followers, and hence we are 
considering a communication topology as in Fig. [2] Finally, 
we require that 



yl 



H«(z£) = (x,t)€Xx 



1>N 
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Followers 



Fig. 2. Communication topology of distributed algorithms 



A strategy of the i-th follower is the sequence of functions 
in (Bal and Obi: 



8 i (8 i ) = {(G$ i$t ,Hh t ):k = l t 2,:.,K} 
parametrized by his type 9{ . On the other hand, the outcome 



which will be the value of the social choice. 



function is defined by the sequence of functions in ( 3c i and 
(0: 

g = {(G k L ,H k ):k=l,2,---,K}. 

We call Si(-) a slave algorithm, which can be seen as a 
map from Oj to the space Sj of follower i's strategies. On 
the other hand, g is referred to as a master algorithm. Given 
an element in S, a master algorithm g determines a social 
choice (x, t). Hence, g can be a map from EtoXx R^ so 
that (go s)(0) — (x,t). This way, we can reuse the diagram 
of Fig. [T] with a generalized interpretation. To summarize: 

• Sj is the space of all possible strategies that could 
be taken by followers involved in a game. Notice that 
the state space description of a dynamical system is 
not unique. Hence, we define £ as a space of the 
equivalence classes of slave algorithms that have the 
same input-output behavior. A concrete description of 
the strategy space varies depending on the problem of 
interest. 

• Si : 8j — > £j is a mapping that determines a strategy of 
the i-ih follower with type Oi. Each of these mappings 
for i = 1, • • • , N is referred to as a slave algorithm. 

. A mapping g : S -> X x R N , g(s) = (x(s),i(s)) 

is referred to as the master algorithm. A composition 

a = g o s : © — > R N is called a distributed algorithm. 

With this re-interpretation, a mechanism (g, S, s) is defined 

as a triplet of a master algorithm g, followers' strategy space 

S, and a suggested slave algorithm s. 

The notion of dominant strategy incentive compatibility is 
often too strong and hard to achieve. Hence, it is common 
to employ a weaker notion of incentive compatibility. 

Definition 1: A mechanism (g, S, s) implements a social 
choice function / in ex-post Nash equilibria if 

(D- 9°s = f 

(2). Vi,Vs 4 e E,,V6Ig 0, 

Vi (xi o {si(9i), S-i(B-i));0i) + U o {si(9 t ), a_i(0_,-)) 

< Vi (ii o (§i, s-i($-i));6i) + iiO ( Si , s-i{d-i)) 
where s — (sj, s_j). In this case, the mechanism is also said 
to be incentive compatible . 



IV. Dual decomposition 
Consider the following cost allocation problem. 



N 

min yivi(xj',$i) 
s.t. Rx = c 



(4a) 



(4b) 



A vector x — [xj; • • • ; xJf] T E X is a concatenation of the 
social decision variables, and the domain X is defined by an 
affine constraint Rx = c. We assume that R = [Ri ■ ■ ■ Rjf] 
is full row rank. 

Let L(x,p) = Y^iLi v i( x i'^i) + P T {Rx - c) be the 
Lagrangian of (Hh. The dual function is given by 



N 



g(p) = miL(x,p) = \ inf (vi(x t ; 9) + p RiX t ) , 



8=1 



and the dual problem is sup p g(p). The primal-dual optimal 
solution (x* ,p*) constitutes a saddle point of L(x,p), and 
assuming strict convexity of Vi(-;9), the saddle point value 
L* corresponds to the optimal value of (HI, The following 
iteration is guaranteed to converge to (x*,p*) 

x\ = argmin (viOc* -1 ,^) + p k ~ lT RiX^ 1 ^ (5a) 



i.k 



p k = p K i + -[(Rx* - c) 



(5b) 



if the step size 7 is chosen to be sufficiently small. At each 
step of the above iteration, we have an upper and lower 
bound for the optimal value of |4]). A lower bound b can 
be computed using current x and p by 



/v 



b := J^ (vi(xi',6i) +p T R l a 



8=1 



inf L(x,p) < sup inf L(x,p) = L* 



Although the equality constraint ( 4b 1 may not be satisfied by 
the current x, the nearest feasible point x from x is given 
by 

x = x- R T (RR T y 1 (Rx - c). 

Using this x, an upper bound b of the optimal value of M 
can be computed by 

JV 

b:=^Vi{xi-A)>L*. 

4=1 

Practically, one terminates the iterative procedure d5l) once 
the observed tolerance b — b is sufficiently small. 

Notice that the above algorithm has an attractive form for 



a distributed implementation since (5a 1 can be executed by 



the z-th follower and (5bi can be executed by the leader. 



Namely (5a 1 and (5b 1 is in the form of (p) (See (|8]l below). 
By increasing the number of iterations, the intended social 
decision can be approximated with an arbitrary accuracy, 



provided that the followers faithfully implement (5ai. In what 
follows, we consider what kind of side payment mechanism 
ti suffices to incentivise followers to be faithful. 



1) Pure competitive market: In a pure competitive market, 
every follower believes that the price of a commodity is 
a given constant that cannot be manipulated by his sole 
action (i.e, followers are price-takers). Such an assumption 
is employed in the standard tatonnement process which, after 
K iterations, charges ti = p K RiXi on each follower. In this 
model, the dual variable p can be naturally understood as the 
price of commodities, which defines followers' net cost 

Ui = Vi(xi]9i) +p T RiXi. 

With the belief that the price is locally constant, following 
(5a 1 is a rational choice for a price-taking follower. 

2) Oligopoly: Many realistic markets are oligopoly, in 
which there exists a stakeholder who knows that his actions 
give certain effects on the market [10]. In this case, a 



stakeholder might be better off by deviating from (5a 1 and 
taking an alternative strategy. 

Example 1: Consider the following simple problem: 



1 2 1 
mm -x Y + - 

S.t. X\ + X2 z 



■ r 2 



1. 



The iteration |5]l leads to the primal-dual optimal solution 
{x\,X2,p*) = (1/2,1/2,-1/2). The corresponding optimal 
value is L* = 1/2 and agents' augmented costs are u\ — 
u% = —1/8. To demonstrate that following (5a 1 is not 



necessarily a rational strategy for the agents when the tax 
mechanism is ti = pXi, suppose that player 1 is a stakeholder 
(a quantity leader, [10]) who knows how p and X2 react to 
his action X\. This leads to a game with two agents, who 
are trying to minimize Ui(xi,p) = l/2xf + px. L , i = 1,2, 
and a market who is trying to maximize L(xi,X2,p) = 
1/2x1 + 1/2x2 + p( x i + x 2 — !)■ Assuming that the agent 
1 is the leader in the Stackelberg game and others are 
followers, reaction curves are given by X2{x\) = 1 — X\ 
and p(xi) = X\ — 1. Hence, suppose that agent 1 takes a 
strategy to follow the following update rule instead of d5l: 

d 



i.k-1 



l-p-ui{xi,p{xi)). 

ax 1 



(6) 



With other players remaining to follow d5J, the new dy- 
namics leads to a Stackelberg equilibrium (xj, ir^p*) = 
(1/3,2/3,-2/3). Notice that player 1 achieves a smaller 
augmented cost u\ — —1/6 at the new equilibrium, even 
though the distributed algorithm as a whole clearly failed to 
find the solution to the original resource allocation problem. 
In this sense, the strategy of following (J5]l by no means 
constitutes a Nash equilibrium. 

V. Faithful implementation of dual 

DECOMPOSITION 

We are going to introduce a monetary transfer function t 
that incentivises followers to implement d5), For a sufficiently 
large K, a social decision 



;.A" 



R T {RR T )-\Rx K -c) 



approximates the optimal solution of (HI with an arbitrary 
accuracy. A natural choice of ti inspired by the Groves 
mechanism is then 



U 






Vi{xi\6i). 



(7) 



Throughout the algorithm, we require the followers to report 
not only x\ but also the value Vi {x^ ; 9) so that the leader is 
able to perform a convergence analysis and compute ti. The 
proposed distributed algorithm is summarized in Algorithm 
[T] Note that the algorithm is parametrized by n £ N, which 
guarantees the accuracy 1/n of the final result. 

Algorithm 1 Distributed mechanism M n = (g n ,'E n ,s n ) 
Input: Problem data, step size 7 
Output: Social outputs x, £1, • • • , tpj 
(F) Initialize x\, • • • , £n', 
(L) Initialize and broadcast p and x; 
while b — b > 1/n do 

(F) Compute and report vi = Vi(xf, 9i); 
(F) Find xi = arg min^ (u; (it; ; 0,) + p T RiXi) 
and report xi and i>i — Vi{xi\ 9i); 
(L) Compute upper bound b = J2i=i v i\ 
(L) Compute lower bound b = Yli=i (^* + V x i)\ 
(L) Compute constraint violation e = Rx — c; 
(L) Update dual variable p := p + je; 
(L) Find nearest feasible point x — x — R(RR T )~ 1 e; 
(L) Broadcast p and x: 
end while 

(L) Determine social decision x = x; 
(L) Determine tax values ti — Y^jjti v i> 



Note that Algorithm [T] suggests followers' strategies s™(-) 
and a social output function g n = (x n ,t n ). One possible 
state space description of the follower's strategy 

Si(0) = {(Gt ei ,H* 6i ): 



1,2, 



,K(n)}. 



is obtained by considering y^ — (p; x) as the leader's output 
and 



Xi 


= 


v i (x l ) 
argmin^ (vi(Xi) +p T RiXi) 


Vi 
Xi 
Vi 


= 


Vi 

x% 

_ v i (x i ;9 l ) 


k-1 fc-1^ 



(8a) 



(8b) 



ti 1 



X4) 



The number of steps K(n) is not known a priori but is finite. 
The strategy space E" for the «-th follower is the space 
of causal mappings from y\ , ■ ■ ■ ,y L to y°, • • • , J 
This way Algorithm [T] defines a sequence of mechanisms 

{M„}„ eN , M n = (j n ,E n ,s n ). 

Notice that the payment t obtained in Algorithm [T] is only 
an approximation of the correct VCG payment because, as 
per d7), it is computed using the final value of x, as opposed 



to the optimal social decision. Hence generally it does not 
guarantee incentive compatibility in the sense of Definition 
[T] Such a fragile aspect of the VCG mechanism is considered 
in [6]. 

Definition 2: A sequence of mechanisms {M„} nG N, 
M n = (g",S n ,s™) is said to asymptotically implement a 
social choice function / in ex-post Nash equilibria if for 
every <5i > 0, 82 > 0, there exists N £ N such that for any 
n > N, 

(1). \\g n o s n - f\\ < 8 X 
(2). Vt,VJ?€£?,V0€e, 

Vi {x? o (s?(9i), «»,(«_,))); 9 t ) + % o (s?(9i), s%(9^)) 

In this case, {Af n }„ 6 N is said to be asymptotically incentive 
compatible. 

Remark 1: For a fixed n £ N, M n is not incentive com- 
patible. However, as n — > 00, M n provides every follower 
a diminishing incentive to deviate from the suggested slave 
algorithm. 

Theorem Is Assume that Vi(-;6i),i — 1,2, • • • ,N are 
strictly convex for every 9i £ <di, and define a social choice 
function / = (a;, t) by 

N 

x : © — > X, x(9) = argmin \^ Vi(xf, 9i) 

Xi,— , X N i = 1 

t-. e^R n ,u(9) =^2v j (x j (ey,0 j ). 

Then the sequence of mechanisms {M n }„ e N provided in 
Algorithm [T] asymptotically implements / in ex-post Nash 
equilibria. 

Proof: By the convergence property of the dual decom- 
position algorithm, we have 

x n o s n (9) — > x{9) as n -> ex). 

As a result, by the continuity of Vi, V? = 1, • • • , N, 

as n — > 00. This proves the first condition of Definition [2] 
To prove the second condition, suppose that there exist a 
sequence of strategies {s"} nS N, 82 > 0, and a subsequence 
{rii} in N such that 

Vi (x? o (*?' (*i), »-'«*-<))! ft) +*?' ° (sT(0i),s%(e-i)) 



) >«i sr°(C'>A(M);ft +% l °(§?,s n ! i (9-i))+8 2 



(9) 



for all / e N. Notice that 



is a feasible point in the original optimization problem, and 



JT^i 



Hence 



(RHS of (9)) = Vi($n;0i) + ^ v j(%j;0j) + h 



J& 



N 



= J^ v i (x l ; Oi) + 5-2 > L* + S 2 . 

On the other hand, by definition of Algorithm [TJ it is 
guaranteed that 

N 

(LHS of g)) = Y, v (*? 'A) = b ni 

4=1 

with b n > - b ni < l/m- Since b n ' < L* < b n \ 
(LHS of |9|) < L* + l/m. Thus we have shown that 

L* +6 2 < (RHS of @) < (LHS of Q) < L* + l/m. 

However, since it is possible to take a sufficiently large I so 
that 82 > l/m, the above inequality lead to a contradiction. 



VI. Dynamic dual decomposition 

In our earlier study [8], [9], we have proposed a real- 
time electricity pricing scheme that incentivises strategic 
consumers/generators over the power grid to implement the 
socially optimal control action. We have assumed that there 
is no private information so that leader is able to compute 
the socially optimal control. The motivation of introducing 
a payment mechanism in our scenario was not to induce 
followers a faithful information revelation as in the classical 
mechanism design problems but to induce them to take 
the intended control actions. Our payment mechanism was 
strongly inspired by the VCG mechanism, but due to this 
difference, the connection to the classical mechanism design 
setting was not transparent. 

Notice that the formulation of the distributed mecha- 
nism introduced in this paper contains both the classical 
mechanism design problem and the pricing scheme [8], [9] 
as special cases. The classical mechanism design problem 
corresponds to the single step case (K = 1) in p), while 
the pricing scheme in [8], [9] corresponds to the case where 
there is no private information (0 is a trivial singleton set). 

Moreover, the distributed mechanism for dual decompo- 
sition algorithm considered in this paper suggests a better 
implementation of the real-time pricing scheme. In our 
earlier study, the leader (the central computer) needs to solve 
a large scale optimal control problem in the centralized 
manner. Using the idea of dynamic dual decomposition 
(e.g., [11]) combined with the VCG-like tax mechanism 
Q, computation can be faithfully parallelized. Furthermore, 
since the current framework is built on non-singleton type 
space 0, it allows strategic power generators/consumers to 
have private information. More details will be explored in 
our future work. 



VII. Faithful Average Consensus Implementation 

As an application of the approach presented above, we 
now consider average consensus seeking using dual de- 
composition when dealing with strategic agents. Let an 
undirected graph Q — ({1, . . . ,N},£), with vertex set 
{1, . . . ,7V} and edge set £, be given to illustrate the com- 
munication links between the agents (see Fig. [2]). Follow- 
ing [12], we can achieve the average consensus through 
solving the optimization problem 



N 

min }(Xi -6i) 2 



j=i 



s.t. Xi = Xj,\f(i,j) G E , 



(10a) 



(10b) 



where Xj € K denotes the decision variable of agent i, 1 < 
i < N, and 9i £ 0,: C M is its type. Note that our assumption 
of considering scalar consensus problem is only in place 
to simplify the presentation and the results can be readily 
extended to higher dimensional cases using the same line of 
reasoning. Let us introduce the incidence matrix of Q. To do 
so, we need to assign arbitrary directions to the edges of Q. 
It is important to note that the underlying graph (specifically, 
the communication graph) is still an undirected graph. Let 
us define the incidence matrix B(Q) G {-1, 0, +l} 7Vx|£| 
so that b,ij(Q) = 1 if the edge ej 6 £ leaves vertex i, 
bij(G) = —1 if the edge ej 6 £ enters vertex i, and 
bij(G) = otherwise. In the rest of the section, we assume 
that Q is a tree. Using the incidence matrix, we can rewrite 
the optimization problem in ( flu) as 



N 

min > (Xi — ( 

2 = 1 

s.t. Rx = 0, 



i)\ (Ha) 

(lib) 

where R = B(Q) T . Clearly, the optimization problem ( [TTj ) 

is of the form discussed in (4) when substituting Vi(xi]9i) = 

(xi — Oi) 2 for all 1 < i < N. Noting that this optimization 

problem satisfies the Slater's condition, the duality gap is 

indeed zero and we can solve the problem using the dual 

decomposition [13, p. 226]. As a result, Algorithm [TJ can 

be used to handle situation where, unlike in the classical 

literature (e.g., [12], [14], [15]), the agents engaged in the 

averaging process are strategic. However, we present two 

other algorithms which, unlike Algorithm [TJ allow for direct 

communication between the followers and therefore, can be 

considered more desirable. Before stating the results, let us 

define the sequence of mechanisms {M^jngN, where each 

mechanism M' n is introduced in Algorithmic] Furthermore, 

note that Algorithm [2] suggests followers' strategies s™(-) 

and a social output function g n — (i n ,t n ). 

Proposition 1: Define a social choice function / = (x,t) 

by 

/l£ \ 

(12a) 

(12b) 







■a 


N 


\ 


x : e -> X, 


X(9) : 


i=l . 


h 


■.e^R n ,t 


m = 




■m- 


otf, 



Algorithm 2 Distributed mechanism M' n = (<?", £",£") for 
asymptotically implementing the average consensus. 
Input: Problem data, step size 7 
Output: Social outputs x, £1, . . . ,£jv 
(F) Initialize X\,..., x^; 
(L) Initialize and broadcast p; 
repeat 

(F) Each agent solves xt = argmin zgR (z — ft) 2 + 
p T RiZ and transmit it to the leader; 
(F) Each agent calculates Wj = (ja — 9i) 2 and transmit 
it to the leader; 

(F) Update dual variables pe = pe + 7(2^ — Xj) for all 
edges et = (i,j) e £; 
(L) Compute ||i?x||2; 
until ||ifcE|| 2 < 1/n 
(L) Determine the social decision x 



(L) Determine the tax values U = Y^ 



■>", 
■_,. u,; 



Algorithm 3 Distributed mechanism M" = (g n , S™, i") for 
asymptotically implementing the average consensus. 
Input: Problem data 
Output: Social outputs x, t\ , . . . , In 

(L) Set a € (0, l/d ma x) (where ft nax denotes the maxi- 
mum degree of the vertices in Q) and broadcast it; 
(F) Initialize z,(0) = ft for each 1 < i < N; 
(F) Initialize r = 0; 
repeat 

(F) Increase iteration number t by one; 
(F) Each agent calculates z-j(t) = Zi(r— 1) H-aX^'eAT- 
(zj(t — 1) — Zi(r — 1)), where A/i is the set of all 
neighbors of vertex i in Q, and transmit it to the leader; 

(F) Each agent computes Vi = (.^(t) — ft) 2 and transmit 

it to the leader; 

(L) Calculate \\Rz{t)\\ 2 ; 
until \\Rz(t)\\ 2 < l/n 
(L) Determine the social decision x = z(t); 



(L) Determine the tax values i \ = ^ 



■ / ■ v-i ; 



where 1 denotes the vector of all ones in R w . Then the 
sequence of mechanisms {M' n \ ne ^ provided in Algorithmic] 
asymptotically implements / in ex-post Nash equilibria. 

Proof: The proof follows the same line of reasoning as 
in the proof of Theorem [T] ■ 

Remark 2: As we have described in Algorithm [2] the 
agents need to solve Xi = argmin zeK (z — ft) 2 + p RiZ. 
This optimization problem has a explicit solution x, = 9i — 
0.5p T Ri. Therefore, at each iteration, the agents only need 
to apply a simple linear update rule, calculate the new cost, 
and send these information to the leader. 

Note that {M^} ng N is not the only sequence of mecha- 
nisms that asymptotically implements the average consensus. 
In order to show this, we define the sequence of mechanisms 
{M^'jngN using Algorithm p] and show that this sequence 



indeed asymptotically implements the average consensus. 
Again, Algorithm [3] suggests followers' strategies s"(-) and 
a social output function g n = (x n ,t n ). 

Proposition 2: Define a social choice function / = (x,t) 
by ( |12) , Then the sequence of mechanisms {M"}„ e pj pro- 
vided in Algorithm[3]asymptotically implements / in ex-post 
Nash equilibria. 

Proof: Following [16], since Q is a tree and a € 
(0,1/dmax), we have lim r ^ oc z(t) = (A" 1 J2?=i ft) 1 - 
Thus, we clearly get lim n _ J . 00 x n os n (9) = x(9). Considering 
the continuity of the cost functions, we can also recover 
limn-**,*? o s n (9) = Y, m (Xj(0) - ft) 2 ■ Evidently, for 
any 5 2 > 0, there exists n\ e N such that ( fT3J l holds true for 
all n > n\. Therefore, 

(»?o (*?(»<), *^(»-<))- ft) 2 

+tX*?(*<),«:ii(0-i))-*2/2 



< (xi(9) 



i f + J2(x j (e)-o j ) 2 . 



(15) 



i¥* 



Now, assume that there exists an index i such that agent i fol- 
lows {s"} n£ N- Clearly, by the construction of Algorithm [3] 
we have lim rwoo Rx n o (s"(ft), s"j(0_j)) = 0. Therefore, 
because of the fact that z(r) = (I — aR T R)z(t — 1), 
we know that the limit lim n _ i . 00 x n o (s"(ft), s™j(#_i)) 
indeed exists. Let us use the notation £(0) = linin^oo a;" o 
(s?(9i),S-i(Q-i))- Because of the continuity of the cost 
functions, for any 5 2 > 0, there exists n 2 € N such that ( p"4| ) 
holds true for all n> n 2 . Therefore, 



(xi(ey 



,)* 



(16) 



2 +£&•(*) 

<(i?o(w l ) I «! J (y 

+ i>(^(ft), S IL i (ft_ i ))+ ( J 2 /2. 

Furthermore, because x(ft is a feasible point and x(ft is the 
global solution of ( fTT) (see [12]), the following inequality 



holds 






<(^)~ ft) 2 + £(%(#) -ft) 



(17) 



i#* 



Finally, combining ( fl5| l, (JT3J, and (jTTJ results in 

(£™o( S nft),^(^))-ft) 2 

+^o(,?(e i ),«!i i (^i))-<y 2 /2 

<(xro(j«(^) !S « 2 (^))-ft) 2 

for n > max(ni, n 2 ). This concludes the proof. ■ 

Remark 3: Algorithms [2] and [3] allow direct communi- 
cations between followers, while Algorithm [T] involves only 
leader-follower communications. Also, unlike Algorithm [Tl 
the social decision x n o s™ as an output of Algorithms [2] or[3] 
may not be feasible (feasibility holds only at the limit, i.e., 
lim„_ i . 00 x n os n £ X). Nevertheless, the notion of asymptotic 
incentive compatibility (Definition p) is still applicable. 



[(x? o ( S ™(^), ^i^-i)) - ^) 2 + *r ° wwi.^ty] - [tew - ^) 2 + E(^( ) - ^) 2 



.?'#* 



< fe/2, (13) 






< S 2 /2, (14) 



VIII. Conclusions 

We presented a framework for faithful implementation of 
dual-decomposition algorithms as well as average consensus 
seeking algorithms in a network of strategic agents. We 
introduced the notion of asymptotic incentive compatibility 
for a sequence of mechanisms, that is, this sequence provides 
every follower a diminishing incentive to deviate from the 
suggested slave algorithm. We proposed a tax mechanism, in- 
spired by the classical Vickrey-Clarke-Groves mechanisms, 
to asymptotically implements a social choice function in ex- 
post Nash equilibria. 
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